[core] Don't download recorded step inputs on replay (resolveData: 'skip-step-inputs') - #4348

python-node (62 failed):

• promiseAllWorkflow | wrun_41M3A9TVCR0GJBWTTHTH2B449D | 🔍 observability
• promiseRaceWorkflow | wrun_41M3A9TVCR0GJBWTTHTH2B449E | 🔍 observability
• promiseAnyWorkflow | wrun_41M3A9TVCR0GJBWTTHTH2B449F | 🔍 observability
• retainedInterleavingWorkflow | wrun_41M3A9V1QV0GZRSWN7V6Y1CQ7H | 🔍 observability
• hookWorkflow | wrun_41M3A9V6YB0GX5YKW9JAKRC2K4 | 🔍 observability
• hookWorkflow is not resumable via public webhook endpoint | wrun_41M3A9V7470GH5V6FWA102VK39 | 🔍 observability
• sleepingWorkflow | wrun_41M3A9VFWF0GTJ764CX4YN2YKH | 🔍 observability
• parallelSleepWorkflow | wrun_41M3A9VHJ30GTH52XRSQQV5MFN | 🔍 observability
• sleepWinsRaceWorkflow | wrun_41M3A9VJQV0GM7SBP0J9KKSQEM | 🔍 observability
• stepWinsRaceWorkflow | wrun_41M3A9VNEF0GP15N4CNADZ7ZMR | 🔍 observability
• nullByteWorkflow | wrun_41M3A9VSY60GXV62T26S7YBK84 | 🔍 observability
• outputStreamWorkflow no startIndex (reads all chunks)
• outputStreamWorkflow positive startIndex (skips first chunk)
• outputStreamWorkflow negative startIndex (reads from end)
• outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns correct index after stream completes
• outputStreamWorkflow - getTailIndex and getChunks getChunks returns same content as reading the stream
• outputStreamInsideStepWorkflow - getWritable() called inside step functions | wrun_41M3A9W9770GP2H8XC7ZRQSYGD | 🔍 observability
• utf8StreamWorkflow | wrun_41M3A9WAX20GQTP7CAWFCVPQV2 | 🔍 observability
• writableForwardedFromWorkflowWorkflow | wrun_41M3A9WB4D0GYWXQ9WE13ZW67B | 🔍 observability
• writableForwardedFromStepWorkflow | wrun_41M3A9WDSJ0GT3DSEWG1XF5GT8 | 🔍 observability
• promiseRaceStressTestWorkflow | wrun_41M3A9WG1M0GYDMARQKEVEECCK | 🔍 observability
• error handling retry behavior regular Error retries until success
• error handling retry behavior FatalError fails immediately without retries
• error handling retry behavior RetryableError respects custom retryAfter delay
• error handling retry behavior maxRetries=0 disables retries
• error handling catchability FatalError can be caught and detected with FatalError.is()
• error handling catchability step throw round-trips FatalError with cause chain to workflow catch
• error handling catchability workflow throw round-trips FatalError + cause through run_failed event
• error handling not registered StepNotRegisteredError fails the step but workflow can catch it
• error handling not registered StepNotRegisteredError fails the run when not caught in workflow
• hookCleanupTestWorkflow - hook token reuse after workflow completion | wrun_41M3A9XZ3N0GYB8QWQVY2AXSX7 | 🔍 observability
• concurrent hook token conflict - two workflows cannot use the same hook token simultaneously | wrun_41M3A9XTWX0GJBW5Q81VEWBPSC | 🔍 observability
• hookGetConflictWorkflow - awaiting hook.getConflict() registers hook without payload | wrun_41M3A9XXEA0GQNCTDZ7R9A6377 | 🔍 observability
• 'hookGetConflictWithPriorStepWorkflow' - hook.getConflict() does not block step execution | wrun_41M3A9Y03A0GV8NQEE3MZFF6W3 | 🔍 observability
• 'hookGetConflictWithParallelStepWorkfl…' - hook.getConflict() does not block step execution | wrun_41M3A9Y03M0GQCVMHH9W004W44 | 🔍 observability
• hookGetConflictThenStepParallelWorkflow - hook.getConflict() continuation step runs alongside other steps | wrun_41M3A9Y05C0GV3J910199H583S | 🔍 observability
• hookGetConflictWorkflow - hook.getConflict() resolves with the conflicting run when token is already registered | wrun_41M3A9Y7H10GXWTJYXB0H33C1E | 🔍 observability
• hookClaimOnlyMutexWorkflow - hook works as a pure run mutex without payload data | wrun_41M3A9YS9C0GPZRWNWR0WV2HP7 | 🔍 observability
• hookAdoptOwnerResultWorkflow - duplicate adopts the owner result via conflict.returnValue | wrun_41M3A9YEJZ0GMTJFNDAGPJFPVY | 🔍 observability
• hookSignalOwnerWorkflow - duplicate forwards its payload to the owner via resumeHook | wrun_41M3A9YH3B0GKB55KF1PMFR6YN | 🔍 observability
• resume-or-start route pattern - resumeHook retried after start() reaches the new run | wrun_41M3A9Z5860GMDVC0ATKYWF0ZX | 🔍 observability
• hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_41M3A9ZA9E0GPRPQPFVVHH6EW2 | 🔍 observability
• hookTokenReuseLoopWorkflow - same run recreates a hook with the same token after dispose() | wrun_41M3A9Z8EB0GKRHZWJMTKTFC9S | 🔍 observability
• spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step | wrun_41M3A9ZSV60GKF7XQQYN9AVHNB | 🔍 observability
• cancelRun - cancelling a running workflow | wrun_41M3AA0MDN0GJW0GT9PKC1PC21 | 🔍 observability
• cancelRun via CLI - cancelling a running workflow | wrun_41M3AA0NSB0GKBSCY15GSGDB9G | 🔍 observability
• hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_41M3AA0QEC0GS5X5F3868YHTJZ | 🔍 observability
• hookWithSleepFinalStepWorkflow - step only on final payload | wrun_41M3AA0SJB0GHVN64YPX6JJ23F | 🔍 observability
• sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M3AA0TZ50GP7JHSKSJYNTSGE | 🔍 observability
• sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) | wrun_41M3AA0WCD0GX7H9BBSWJ6YMPX | 🔍 observability
• AbortController abortTimeoutWorkflow: timeout cancels long-running step
• AbortController abortParallelWorkflow: abort cancels all parallel steps
• AbortController abortReasonWorkflow: abort reason preserved across boundaries
• AbortController abortViaHookWorkflow: external hook triggers abort on in-flight step
• metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (#1577) | wrun_41M3AA1AJB0GSYTQYR5RX274XP | 🔍 observability
• resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M3AA1APQ0GN41GRB91ZYJADK | 🔍 observability
• setAttributes start: initial attributes are seeded on run creation
• setAttributes start: reserved-prefix initial attributes are seeded with allowReservedAttributes
• setAttributes setAttributesWorkflow: workflow-body calls append native attr_set events and merge correctly
• setAttributes setAttributesInsideStepWorkflow: step-body calls append attributed native events
• setAttributes Promise.all of disjoint-key writes: every key lands
• setAttributes workflow throws after awaited setAttributes: attribute still persists on the failed run

• cold-start-warmup · suite warmup (python) · at 18:12:41Z · abandoned wrun_41M3A9SM0J0GRP9RZ2WNY491E8 · (+7 more)
• run-pickup-stall · retainedInterleavingWorkflow (python) · at 18:12:58Z · abandoned wrun_41M3A9X91S0GSGG0DZTGFR061S
• run-pickup-stall · promiseAnyWorkflow (python) · at 18:12:58Z · abandoned wrun_41M3A9X91S0GSGG0DZTGFR061R
• run-pickup-stall · promiseAllWorkflow (python) · at 18:12:58Z · abandoned wrun_41M3A9X91R0GJ8NAAQ3G752VJ7
• run-pickup-stall · hookWorkflow (python) · at 18:12:58Z · abandoned wrun_41M3A9X91Y0GN3PYHJBX0AF7QY
• run-pickup-stall · promiseRaceWorkflow (python) · at 18:12:58Z · abandoned wrun_41M3A9X91S0GSGG0DZTGFR061Q
• run-pickup-stall · retainedInterleavingWorkflow (python) · at 18:13:45Z · abandoned wrun_41M3A9YQKK0GV7QRPG3KMSSF3X
• run-pickup-stall · hookWorkflow (python) · at 18:13:45Z · abandoned wrun_41M3A9YQQZ0GXSSRXYX9D51VB2
• run-pickup-stall · promiseAllWorkflow (python) · at 18:13:59Z · abandoned wrun_41M3A9Z4JV0GW6GDP26VV6JHXC
• run-pickup-stall · promiseAnyWorkflow (python) · at 18:13:59Z · abandoned wrun_41M3A9Z4MA0GWY8ZYG5JA3J2JH
• run-pickup-stall · promiseRaceWorkflow (python) · at 18:13:59Z · abandoned wrun_41M3A9Z4Z80GQSRPNX1N9D7W7V
• run-pickup-stall · hookWorkflow is not resumable via public webhook endpoint (python) · at 18:14:33Z · abandoned wrun_41M3AA05ZT0GVP8GTSK1TYDZ62
• run-pickup-stall · sleepingWorkflow (python) · at 18:14:34Z · abandoned wrun_41M3AA06ZG0GH0XNDX5023E0K1
• run-pickup-stall · parallelSleepWorkflow (python) · at 18:15:01Z · abandoned wrun_41M3AA10FQ0GM06K1427857E3Q
• run-pickup-stall · sleepWinsRaceWorkflow (python) · at 18:15:02Z · abandoned wrun_41M3AA10W60GSJHGGMC52C4ESG
• run-pickup-stall · stepWinsRaceWorkflow (python) · at 18:15:25Z · abandoned wrun_41M3AA115K0GJ521ECVT1XZZGR
• cold-start-warmup · suite warmup (tanstack-start) · at 18:15:35Z · abandoned wrun_01M3AA199M7M7ERT7Q8WXW4C22 · (+1 more)
• run-pickup-stall · hookWorkflow is not resumable via public webhook endpoint (python) · at 18:16:36Z · abandoned wrun_41M3AA2QNR0GHJV4684XQG45Q5
• run-pickup-stall · sleepingWorkflow (python) · at 18:16:36Z · abandoned wrun_41M3AA2QVB0GPN3M3FAW9KZTX8
• run-pickup-stall · stepWinsRaceWorkflow (python) · at 18:16:36Z · abandoned wrun_41M3AA3S240GGKJPBGSM4P74TQ
• run-pickup-stall · parallelSleepWorkflow (python) · at 18:16:37Z · abandoned wrun_41M3AA3RC70GQZHHBVYNCM4EHW
• run-pickup-stall · sleepWinsRaceWorkflow (python) · at 18:16:37Z · abandoned wrun_41M3AA3RRQ0GKPYSRWTYJGS129
• run-pickup-stall · nullByteWorkflow (python) · at 18:16:57Z · abandoned wrun_41M3AA4JZC0GGRPQMPSK95G9QK
• run-pickup-stall · no startIndex (reads all chunks) (python) · at 18:16:57Z · abandoned wrun_41M3AA4K690GN1JKEHWNCPDGHG
• run-pickup-stall · positive startIndex (skips first chunk) (python) · at 18:17:30Z · abandoned wrun_41M3AA5JZ80GZNDXXSCXRGW19G
• run-pickup-stall · negative startIndex (reads from end) (python) · at 18:17:30Z · abandoned wrun_41M3AA5KBR0GGC7HVXBS4DMWA2
• run-pickup-stall · getTailIndex returns correct index after stream completes (python) · at 18:17:33Z · abandoned wrun_41M3AA5P120GX9HTT7DYWX0H4T
• run-pickup-stall · getTailIndex returns -1 before any chunks are written (python) · at 18:17:57Z · abandoned wrun_41M3AA6DJC0GXM5KCTKP89FY22
• run-pickup-stall · getChunks returns same content as reading the stream (python) · at 18:17:57Z · abandoned wrun_41M3AA6DS90GXVCFD0K7G4NZ7B
• run-pickup-stall · outputStreamInsideStepWorkflow - getWritable() called inside step functions (python) · at 18:18:14Z · abandoned wrun_41M3AA6XQ90GYN6VYCX3C4A9B2
• run-pickup-stall · utf8StreamWorkflow (python) · at 18:18:30Z · abandoned wrun_41M3AA7DJ90GP50Z2C4C8Y1EGD
• run-pickup-stall · nullByteWorkflow (python) · at 18:18:33Z · abandoned wrun_41M3AA7GM20GSMH5CEXPT2WGT7
• run-pickup-stall · no startIndex (reads all chunks) (python) · at 18:18:33Z · abandoned wrun_41M3AA7GY40GJXDBZYCZKKFA9X
• run-pickup-stall · positive startIndex (skips first chunk) (python) · at 18:18:57Z · abandoned wrun_41M3AA88C90GNCNPVHX974FK54
• run-pickup-stall · negative startIndex (reads from end) (python) · at 18:19:14Z · abandoned wrun_41M3AA8S410GMS6PT1W3JMRAFF
• run-pickup-stall · getTailIndex returns correct index after stream completes (python) · at 18:19:34Z · abandoned wrun_41M3AA9C160GVY6YFEQSR7K893
• run-pickup-stall · getChunks returns same content as reading the stream (python) · at 18:19:36Z · abandoned wrun_41M3AA9DWX0GWGVQP0MBV7GDN2
• run-pickup-stall · outputStreamInsideStepWorkflow - getWritable() called inside step functions (python) · at 18:19:57Z · abandoned wrun_41M3AAA2Z90GQQ5PHKRVPQNYWD
• run-pickup-stall · writableForwardedFromWorkflowWorkflow (python) · at 18:20:15Z · abandoned wrun_41M3AAAKQ20GYYHA1K6WAHNGVJ
• run-pickup-stall · writableForwardedFromStepWorkflow (python) · at 18:20:32Z · abandoned wrun_41M3AAB4ZN0GR8H22ECSWBGC54
• run-pickup-stall · utf8StreamWorkflow (python) · at 18:20:34Z · abandoned wrun_41M3AAB6M60GS7P65P6RZJHTV6
• run-pickup-stall · promiseRaceStressTestWorkflow (python) · at 18:20:38Z · abandoned wrun_41M3AABAFX0GWKH9X2VCDPSTVD
• run-pickup-stall · crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context (nextjs-webpack) · at 18:20:40Z · abandoned wrun_01M3AABE66Q7P85QAR0KYYRGA7
• run-pickup-stall · regular Error retries until success (python) · at 18:20:58Z · abandoned wrun_41M3AABYCN0GW0T2N5DV12SAN2
• run-pickup-stall · FatalError fails immediately without retries (python) · at 18:21:38Z · abandoned wrun_41M3AAD52X0GZ1FVBBFN82PD65
• run-pickup-stall · RetryableError respects custom retryAfter delay (python) · at 18:21:58Z · abandoned wrun_41M3AADRZN0GYQKHT89KA89Z8B
• run-pickup-stall · maxRetries=0 disables retries (python) · at 18:22:14Z · abandoned wrun_41M3AAE8X10GMHVM15ER5YZ4N8
• run-pickup-stall · FatalError can be caught and detected with FatalError.is() (python) · at 18:22:32Z · abandoned wrun_41M3AAET5N0GKFB455BSKAEC8G
• run-pickup-stall · step throw round-trips FatalError with cause chain to workflow catch (python) · at 18:22:34Z · abandoned wrun_41M3AAEVT60GWMMNKZV3YR66M7
• run-pickup-stall · workflow throw round-trips FatalError + cause through run_failed event (python) · at 18:22:38Z · abandoned wrun_41M3AAEZNY0GWVFN31V440PEDJ
• run-pickup-stall · StepNotRegisteredError fails the step but workflow can catch it (python) · at 18:22:58Z · abandoned wrun_41M3AAFKJQ0GG07B99KD4BM5NR
• run-pickup-stall · StepNotRegisteredError fails the run when not caught in workflow (python) · at 18:23:19Z · abandoned wrun_41M3AAG3G20GKN2PRABGFSP27F
• run-pickup-stall · promiseRaceStressTestWorkflow (python) · at 18:24:19Z · abandoned wrun_41M3AAHPEH0GGARVHM9B15N1HP
• run-pickup-stall · regular Error retries until success (python) · at 18:24:46Z · abandoned wrun_41M3AAHY330GP1TGYEG6SJXWFC
• run-pickup-stall · writableForwardedFromWorkflowWorkflow (python) · at 18:24:48Z · abandoned wrun_41M3AAHZ1W0GNVSKH979KVV2H0
• run-pickup-stall · writableForwardedFromStepWorkflow (python) · at 18:24:49Z · abandoned wrun_41M3AAHZE80GZKB9FHWSE8BKAE
• run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (python) · at 18:24:51Z · abandoned wrun_41M3AAJ0HN0GHGY57RTGBEKWCG
• run-pickup-stall · RetryableError respects custom retryAfter delay (python) · at 18:25:47Z · abandoned wrun_41M3AAKV4M0GWD6C9E53C02CV3
• run-pickup-stall · FatalError fails immediately without retries (python) · at 18:25:47Z · abandoned wrun_41M3AAKRP20GSCFMT434C462ZQ
• run-pickup-stall · maxRetries=0 disables retries (python) · at 18:25:54Z · abandoned wrun_41M3AAMEB20GG4JD27AC5PY3R3
• run-pickup-stall · FatalError can be caught and detected with FatalError.is() (python) · at 18:26:15Z · abandoned wrun_41M3AANM1H0GSBH0EKS53KXPAN
• run-pickup-stall · step throw round-trips FatalError with cause chain to workflow catch (python) · at 18:26:15Z · abandoned wrun_41M3AANM7W0GZ1QJQCH8749PBG
• run-pickup-stall · workflow throw round-trips FatalError + cause through run_failed event (python) · at 18:26:16Z · abandoned wrun_41M3AANMM90GX90Q7FJ36GV4JV
• run-pickup-stall · StepNotRegisteredError fails the step but workflow can catch it (python) · at 18:26:19Z · abandoned wrun_41M3AANR100GV71V48AAKCH0TD
• run-pickup-stall · StepNotRegisteredError fails the run when not caught in workflow (python) · at 18:26:38Z · abandoned wrun_41M3AAP9R70GTXSEX12YQ4YNYX
• run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (python) · at 18:27:16Z · abandoned wrun_41M3AAQFN70GZJPR79R7N376B0
• run-pickup-stall · hookGetConflictWorkflow - awaiting hook.getConflict() registers hook without payload (python) · at 18:27:19Z · abandoned wrun_41M3AAQJM10GN5R9FS1XQ81P4G
• run-pickup-stall · 'hookGetConflictWithPriorStepWorkflow' - hook.getConflict() does not block step execution (python) · at 18:27:20Z · abandoned wrun_41M3AAQK8A0GWGSF96ABP4HDBC
• run-pickup-stall · 'hookGetConflictWithParallelStepWorkfl…' - hook.getConflict() does not block step execution (python) · at 18:27:39Z · abandoned wrun_41M3AAR5VE0GWF8F2KTY58QZCC
• run-pickup-stall · hookGetConflictThenStepParallelWorkflow - hook.getConflict() continuation step runs alongside other steps (python) · at 18:28:03Z · abandoned wrun_41M3AARXRE0GSF80683J2GY8NE
• run-pickup-stall · hookGetConflictWorkflow - hook.getConflict() resolves with the conflicting run when token is already registered (python) · at 18:28:19Z · abandoned wrun_41M3AASCZS0GHQ614954776FEY
• run-pickup-stall · hookGetConflictWorkflow - awaiting hook.getConflict() registers hook without payload (python) · at 18:28:20Z · abandoned wrun_41M3AASDYE0GS56PYVAK2ZH96N
• run-pickup-stall · 'hookGetConflictWithPriorStepWorkflow' - hook.getConflict() does not block step execution (python) · at 18:28:20Z · abandoned wrun_41M3AASEHD0GX8EYH4K7BXZGZT
• run-pickup-stall · 'hookGetConflictWithParallelStepWorkfl…' - hook.getConflict() does not block step execution (python) · at 18:28:40Z · abandoned wrun_41M3AAT16A0GWTT36KVX30KFDJ
• run-pickup-stall · hookGetConflictWorkflow - hook.getConflict() resolves with the conflicting run when token is already registered (python) · at 18:29:06Z · abandoned wrun_41M3AATV8W0GM6D20DHDK34Y7P
• run-pickup-stall · hookClaimOnlyMutexWorkflow - hook works as a pure run mutex without payload data (python) · at 18:29:21Z · abandoned wrun_41M3AAV9A10GWXM3D6JE66FNWQ
• run-pickup-stall · hookAdoptOwnerResultWorkflow - duplicate adopts the owner result via conflict.returnValue (python) · at 18:29:22Z · abandoned wrun_41M3AAVA3F0GQ2KAQG8HVV2AFK
• run-pickup-stall · hookGetConflictThenStepParallelWorkflow - hook.getConflict() continuation step runs alongside other steps (python) · at 18:29:34Z · abandoned wrun_41M3AAVPF10GYQMGZN474FVDY4
• run-pickup-stall · hookSignalOwnerWorkflow - duplicate forwards its payload to the owner via resumeHook (python) · at 18:29:40Z · abandoned wrun_41M3AAVWJH0GTHQNB0GH515SQD
• run-pickup-stall · resume-or-start route pattern - resumeHook retried after start() reaches the new run (python) · at 18:29:54Z · abandoned wrun_41M3AAW9NX0GJ42ZCZMR5N0B9A
• run-pickup-stall · hookClaimOnlyMutexWorkflow - hook works as a pure run mutex without payload data (python) · at 18:30:08Z · abandoned wrun_41M3AAWQEF0GYKDCS9HSVXYWB5
• run-pickup-stall · hookAdoptOwnerResultWorkflow - duplicate adopts the owner result via conflict.returnValue (python) · at 18:30:09Z · abandoned wrun_41M3AAWRGW0GX374R7AB1RQMXN
• run-pickup-stall · hookSignalOwnerWorkflow - duplicate forwards its payload to the owner via resumeHook (python) · at 18:30:27Z · abandoned wrun_41M3AAXAAR0GV8FAG2K14SVJA4
• run-pickup-stall · resume-or-start route pattern - resumeHook retried after start() reaches the new run (python) · at 18:30:42Z · abandoned wrun_41M3AAXR560GYN3FVN0T5X1WXZ
• run-pickup-stall · hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running (python) · at 18:30:55Z · abandoned wrun_41M3AAY5BR0GJTS98072T9SCPF
• run-pickup-stall · hookTokenReuseLoopWorkflow - same run recreates a hook with the same token after dispose() (python) · at 18:30:56Z · abandoned wrun_41M3AAY6YW0GV1W3YP40HX101H
• run-pickup-stall · spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step (python) · at 18:31:05Z · abandoned wrun_41M3AAYF490GYS8XM9JJRKKF3F
• run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 18:31:21Z · abandoned wrun_41M3AAYYD30GS5J2TG8B1FAPFK
• run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 18:31:29Z · abandoned wrun_41M3AAZ6P00GR302SFS3B3M987
• run-pickup-stall · hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running (python) · at 18:31:42Z · abandoned wrun_41M3AAZKPK0GZFH55P7JY7EQFV
• run-pickup-stall · hookTokenReuseLoopWorkflow - same run recreates a hook with the same token after dispose() (python) · at 18:31:44Z · abandoned wrun_41M3AAZN4B0GHT7NR4J0YKC73M
• run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 18:31:53Z · abandoned wrun_41M3AAZXXQ0GTE7B9G77QGQE4P
• run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 18:32:01Z · abandoned wrun_41M3AB069D0GX73K9HD4CWYHHV
• run-pickup-stall · hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep (python) · at 18:32:26Z · abandoned wrun_41M3AB0XH70GNQ01K3JW2JRNHY
• run-pickup-stall · hookWithSleepFinalStepWorkflow - step only on final payload (python) · at 18:32:30Z · abandoned wrun_41M3AB11P70GJ7QZCVX40Z99W8
• run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 18:32:31Z · abandoned wrun_41M3AB13BY0GYV3VRGR9EKSDZD
• run-pickup-stall · sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) (python) · at 18:32:34Z · abandoned wrun_41M3AB15QM0GMEGSCDB8HTZ966
• run-pickup-stall · spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step (python) · at 18:33:06Z · abandoned wrun_41M3AB252N0GGTJTVBPQ0ZX98V
• run-pickup-stall · hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep (python) · at 18:33:13Z · abandoned wrun_41M3AB2C920GZKTCKSC08BY5XS
• run-pickup-stall · hookWithSleepFinalStepWorkflow - step only on final payload (python) · at 18:33:17Z · abandoned wrun_41M3AB2FVE0GVYVT9KJTPCQVWX
• run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 18:33:32Z · abandoned wrun_41M3AB2YQY0GP28YFEFKPYX09B
• run-pickup-stall · sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control) (python) · at 18:33:36Z · abandoned wrun_41M3AB31BD0GXM3N792ZF7W1JR
• run-pickup-stall · abortTimeoutWorkflow: timeout cancels long-running step (python) · at 18:34:13Z · abandoned wrun_41M3AB3ZAS0GSMN4P0H5HBY4X9
• run-pickup-stall · abortParallelWorkflow: abort cancels all parallel steps (python) · at 18:34:16Z · abandoned wrun_41M3AB437S0GQ3784D1HXS5387
• run-pickup-stall · metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (Vercel World Regression: getWorkflowMetadata() fully breaking runs #1577) (python) · at 18:34:58Z · abandoned wrun_41M3AB4VYD0GTTVYQFW00EYWRY
• run-pickup-stall · abortReasonWorkflow: abort reason preserved across boundaries (python) · at 18:35:05Z · abandoned wrun_41M3AB4SAZ0GM7YNDE3N5PG0BW
• run-pickup-stall · abortViaHookWorkflow: external hook triggers abort on in-flight step (python) · at 18:36:01Z · abandoned wrun_41M3AB5T8N0GJPWZZPGDHXG4W8
• run-pickup-stall · abortTimeoutWorkflow: timeout cancels long-running step (python) · at 18:36:27Z · abandoned wrun_41M3AB7H7G0GRGEWPQ4NSZGRPK
• run-pickup-stall · abortParallelWorkflow: abort cancels all parallel steps (python) · at 18:36:27Z · abandoned wrun_41M3AB7MVQ0GK16450N045Z9PK
• run-pickup-stall · start: initial attributes are seeded on run creation (python) · at 18:36:33Z · abandoned wrun_41M3AB86KB0GKGHZJCQR25WF8W
• run-pickup-stall · start: reserved-prefix initial attributes are seeded with allowReservedAttributes (python) · at 18:36:39Z · abandoned wrun_41M3AB8H4E0GXDKGS390ZM0VHS
• run-pickup-stall · setAttributesWorkflow: workflow-body calls append native attr_set events and merge correctly (python) · at 18:36:42Z · abandoned wrun_41M3AB8M5G0GHF5N5475704NPP
• run-pickup-stall · setAttributesInsideStepWorkflow: step-body calls append attributed native events (python) · at 18:36:54Z · abandoned wrun_41M3AB93WV0GZNSS34PAZVJ1RK
• run-pickup-stall · abortReasonWorkflow: abort reason preserved across boundaries (python) · at 18:37:02Z · abandoned wrun_41M3AB9BTG0GWM84B6D2V3D512
• run-pickup-stall · metadataFromHelperWorkflow - getWorkflowMetadata/getStepMetadata work from module-level helper (Vercel World Regression: getWorkflowMetadata() fully breaking runs #1577) (python) · at 18:37:05Z · abandoned wrun_41M3AB9EDZ0GWE45Q71WP9QE8J
• run-pickup-stall · abortViaHookWorkflow: external hook triggers abort on in-flight step (python) · at 18:37:06Z · abandoned wrun_41M3AB9FPM0GQG4Z5P4FXAVZT5
• run-pickup-stall · Promise.all of disjoint-key writes: every key lands (python) · at 18:37:09Z · abandoned wrun_41M3AB9JXF0GS3N3ZYPTTBZAGE
• run-pickup-stall · start: initial attributes are seeded on run creation (python) · at 18:37:37Z · abandoned wrun_41M3ABAEF70GZ0YMS1RCXS6GFQ
• run-pickup-stall · start: reserved-prefix initial attributes are seeded with allowReservedAttributes (python) · at 18:37:40Z · abandoned wrun_41M3ABAGY90GG9QV8QVHMZ47MC
• run-pickup-stall · setAttributesWorkflow: workflow-body calls append native attr_set events and merge correctly (python) · at 18:37:53Z · abandoned wrun_41M3ABAXBC0GZTWT7YZDH00S2E
• run-pickup-stall · setAttributesInsideStepWorkflow: step-body calls append attributed native events (python) · at 18:38:03Z · abandoned wrun_41M3ABB7CF0GWKZCMHKEQ5X1D1
• run-pickup-stall · Promise.all of disjoint-key writes: every key lands (python) · at 18:38:06Z · abandoned wrun_41M3ABBAJ40GZAK5066DXCWQBJ
• run-pickup-stall · workflow throws after awaited setAttributes: attribute still persists on the failed run (python) · at 18:38:09Z · abandoned wrun_41M3ABBD4T0GQY9Q86F0Z8ZSHB
• run-pickup-stall · workflow throws after awaited setAttributes: attribute still persists on the failed run (python) · at 18:38:40Z · abandoned wrun_41M3ABCB5X0GNS96HJMQCF52X2

❌ ▲ Vercel Production

✅ 💻 Local Development

✅ 📦 Local Production

✅ 🐘 Local Postgres

✅ 🪟 Windows

✅ vercel-http-transport

✅ vercel-multi-region

✅ vercel-ws-transport

1020 steps (inline)

Cumulative STSO time: main 147518ms → this run 185732ms (Δ +38214ms, +26%)

   50-100 ms  ┃                         main   1  this   0    -1
  100-150 ms  ┃██████████████████████   main 844  this   0  -844
  150-200 ms  ████░░░░░░░░░░░░░░░░░░░┃  main 149  this 876  +727
  200-250 ms  █░░┃                      main  13  this 131  +118
  250-300 ms  ┃                         main   4  this  10    +6
  300-350 ms  ┃                         main   1  this   1    +0
  350-400 ms  ┃                         main   1  this   0    -1
  500-550 ms  ┃                         main   0  this   1    +1
  700-750 ms  ┃                         main   1  this   0    -1
  900-950 ms  ┃                         main   1  this   0    -1
1000-1050 ms  ┃                         main   1  this   0    -1
1150-1200 ms  ┃                         main   1  this   0    -1
1200-1250 ms  ┃                         main   2  this   0    -2

variant  RTT 1ms→5s+              avg         p50         p90           p99     n
control  ······▁█▂·▁▁·  452.5 (+207%)  145 (+16%)  252 (-13%)  4596 (+575%)  3000
sweep    ······▁█▂▁···    160.2 (+4%)  150 (+28%)  278 (-44%)    559 (-21%)  3000
gw 1x    ······▁█▁····    144.1 (+5%)  142 (+26%)  195 (-24%)    327 (-61%)  5295
eve 1x   ······▁█▁····    146.8 (±0%)  142 (+21%)  197 (-20%)    262 (-68%)  5186
eve 2x   ······▁█▄····    172.8 (+7%)  163 (+30%)  258 (-23%)    358 (-59%)  7779

RTT over stream progress (avg per tenth of stream, bars scaled min→max):

control  █▇▇▆▅▄▃▃▂▁  310–588ms
sweep    █▃▂▃▃▁▃▄▂▁  146–196ms
gw 1x    ▃▁▅▃▄▇▄█▅▃  130–161ms
eve 1x   ▃▁▃█▂▆▆▅▅▃  136–159ms
eve 2x   ▁▁▂▂▂▄▆█▆▄  142–225ms

RTT by chunk size (avg per log size bin, ~160B → ~12KB serialized, bars scaled min→max):

sweep  ▅█▆▁▇▁▆  160–161ms

Delivery jitter over stream progress (avg positive CDV per tenth of stream, bars scaled min→max):

control  ▁▄▂▂█▃▅▆▁▃  42–56ms
sweep    ▅▇▁▃█▃█▆▂▃  52–72ms
gw 1x    ▃▃▄▁▅█▆█▅▁  39–50ms
eve 1x   ▄▄▂▆▁▄▅▆▁█  26–33ms
eve 2x   █▅▂▁▆▅▃▂▅▆  24–33ms

6c7dd46

Thu, 24 Sep 2026 03:29:47 GMT · run logs

vercel / nextjs-turbopack

Streams

ead616e

Thu, 24 Sep 2026 01:39:58 GMT · run logs

vercel / nextjs-turbopack

Streams

_{Streams: first-chunk RTT (the stream-open path, before any buffering/backpressure), CRTT percentiles, and worst delivery stall (CDV max). Cells are medians across iterations; per-run values in the artifacts. No 🔴/🟢 marks until targets attach.}

_{The collapsed STSO distribution section above buckets every step gap, split inline (same warm process — pure framework overhead) vs queue-hop (fresh process — dispatch, reinit, replay). █ = main, ┃ = this run, ░ = fill.}

_{The collapsed CRTT drill-down: per-variant RTT histograms (fixed log bins, · = empty) and mean RTT/positive-CDV profile lines over stream progress and chunk size. Histograms, avgs, and profiles merge exactly across runs; p50–p99 are percentile-of-percentiles. Per-index rows live in the artifacts.}

_{Best/P75/P90/P99 deltas compare against the most recent benchmark run on main at the time of this run. 🔻 flags a delta worse than +15%, 💚 one better than −15%.}

_{Metrics — TTFS: time to first step body (in-deployment start() → first step body) · Fan-out TTFS: fan-out time to first step (in-deployment start() → first of the parallel step bodies to complete) · Fan-out TTLS: fan-out time to last step (in-deployment start() → last of the parallel step bodies to complete, i.e. when the Promise.all resolves) · STSO: step-to-step overhead (gap between consecutive step bodies) · WO: workflow overhead (whole-run time outside step bodies, in-deployment anchored) · CRTT: chunk round-trip time (per-chunk write → read latency, one clock domain: deployment → stream backend → same deployment) · CDV: chunk delay variation / delivery jitter (inter-arrival gap minus inter-write gap per seq-adjacent pair; skew-free; the row is each run's MAX positive value, so one stall moves it)}

_{Scenarios — step: one trivial no-op step, no stream; no hooks, so the run stays in turbo mode (in-process fast path) · stream: one streaming step; no hooks, so the run stays in turbo mode (in-process fast path) · hook + stream: registers a hook before one step, which exits turbo mode (dispatch path) · 1020 steps: 1020 trivial sequential steps; STSO is measured between consecutive steps in the given step ranges, and WO is the whole-run overhead outside step bodies · Promise.all(100 steps): 100 trivial no-op steps started together in a single Promise.all; Fan-out TTFS is the first of them to complete and Fan-out TTLS the last, both from the in-deployment clientStart, so their gap is the spread the runtime adds across the fan-out · paced control (100/s, 60B): the control: 300 tiny (~60B) deltas metronome-paced at 100/s — zero workload structure, so it reads the transport floor and flush cadence, and disambiguates transport-wide vs workload-specific when a replay row moves · size sweep (100/s, 160B-12KB): same pacing as the control with deltas padded in rotation across seven log-spaced sizes (~160B–12KB) — rotation decouples size from stream position, so it isolates whether chunk size causes latency · replay gateway-gpt-5.4-nano-2000t (1x): raw provider SSE cadence captured at the AI gateway boundary (gpt-5.4-nano, the most popular gateway model; per-token deltas p50 208B = the modal production chunk size), replayed exactly as measured — the typical customer's workload; its CDV is the typical customer's real delivery jitter · replay eve-gpt-5.6-sol-2000t (1x): a captured eve turn (gpt-5.6-sol, the most-used demanding eve model; ~2000 output tokens = production p50 turn length) replayed exactly as measured — eve's envelope protocol re-ships the cumulative message so sizes ramp 142B→13KB; the demanding outlier tenant's reality · replay eve-gpt-5.6-sol-2000t (2x): the same eve capture at 2x — the headroom/stress row; real fast-tier models emit the same chunk sizes at proportionally higher rate, so time compression is a faithful speed model · first chunk (pooled): every run's seq-0 RTT pooled across all stream scenarios — the first chunk precedes any workload differentiation, so pooling samples one shared stream-open path with exact percentiles}

_{Replay cadences (semantic sha256) — eve-gpt-5.6-sol-2000t eaf22f5946e7c61f3c65c7006d550df180cfabd4e706254a09f22aec0cfb420d · gateway-gpt-5.4-nano-2000t 6f24ac518b6b83ff1d0e85a5fe78230db192716d66a7fc6b2fe022752001d041}

_{🔴 marks a percentile over its target (within target is left unmarked). Targets (p75/p90/p99, ms) — TTFS 200/300/600}

_{All timestamps are deployment-side; runs are triggered in-deployment, so the CI runner and api.vercel.com sit outside every measured window. TTFS = start() → first step body (includes dispatch + any cold start); Fan-out TTFS/TTLS = first/last step completion of one Promise.all from the same anchor (the gap is the runtime’s fan-out spread); STSO/WO between step bodies; CRTT inside the workflow (excludes the api.vercel.com read path).}

_{Cold starts stay in the numbers (real bursty-workload latency, inflates P75+); Best is the warm floor.}

fence=per-spec

Full trace: world-sim.txt

Sizes are gzip; parentheses show the change against main.
Flow route and Step reg. gate this job, on raw bytes rather than the gzip shown, at max(2%, 50.0 KiB). Framework output is informational.

6d38f95 · run